Reconfigurable Antennas, Preemptive Switching and 

Virtual Channel Management 

Santhosh Kumar, Jean-Francois Chamberland, Gregory H. Huff 
Department of Electrical and Computer Engineering, 
Texas A&M University 



(N 

o 

(N 

> 
O 

(N 



t/5 

o 



> 

(N 
O 



(N 



X 



Abstract — This article considers the performance of wireless 
communication systems that utilize reconfigurable or pattern- 
dynamic antennas. The focus is on finite-state channels with 
memory and performance is assessed in terms of real-time 
behavior. In a wireless setting, when a slow fading channel enters 
a deep fade, the corresponding communication system faces the 
threat of successive decoding failures at the destination. Under 
such circumstances, rapidly getting out of deep fades becomes a 
priority. Recent advances in fast reconfigurable antennas provide 
new means to alter the statistical profile of fading channels 
and thereby reduce the probability of prolonged fades. Fast 
reconfigurable antennas are therefore poised to improve overall 
performance, especially for delay-sensitive traffic in slow-fading 
environments. This potential for enhanced performance motivates 
this study of the temporal behavior of point-to-point com- 
munication systems with reconfigurable antennas. Specifically, 
agile wireless communication schemes over erasure channels 
are analyzed; situations where using reconfigurable antennas 
yield substantial performance gains in terms of throughput 
and average delay are identified. Scenarios where only partial 
state information is available at the receiver are also examined, 
naturally leading to partially observable decision processes. 

Index Terms — Data communication, Wireless communication, 
Antennas, Reconfigurable architectures, Adaptive systems Com- 
munication channels. 



I. Introduction 

High-performance reconfigurable antenna technologies are 
collectively emerging as a viable option for smartphones, 
mobile hotspots, and portable computers 0, 0, 0, 0, 0. 
Reconfigurable antennas can be employed in a number of ways 
to increase the connectivity profile and robustness of wireless 
communication channels, and they create new and promising 
opportunities for the engineering of superior communication 
schemes. Such antennas are designed to intentionally and 
reversibly alter the character of their performance-governing 
electromagnetic fields. As a result, they are able to modify 
the directional and polarization properties of their radiation 
patterns and thereby change the spatiotemporal characteristics 
of the communication channels they induce. 

Beyond the basic properties of reconfigurable antennas, it 
is interesting to note that manipulations of radiation patterns 
can be automated through rapid feedback and triggered by 
events such as deep fades and successive decoding failures 
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0, 0, 0, 0- This enables the implementation of closed- 
loop systems with the cognitive ability to seamlessly adapt 
to evolving electromagnetic environments and interference 
conditions. The capacity to provide these features in (near) real 
time is primarily determined by the speed and complexity of 
the reconfiguration mechanisms used to facilitate electromag- 
netic agility within the reconfigurable antenna structures. This 
highlights a natural tradeoff between the potential benefits of 
a configuration change and the downtime associated with each 
transformation event. 

Although reconfigurable antennas have been and continue 
to be the subject of concerted research efforts in the antennas 
and propagation community, a detailed analysis of their reper- 
cussions on the foundations of wireless communications is still 
lacking. Key to the widespread adoption of such technologies, 
aside from miniaturization, is provable gains in terms of 
capacity, delay-throughput profile and network connectivity 
iflOll , ifTTI . This article seeks to address the need for better 
understanding the impact of adaptive antenna systems. From 
a conceptual point of view, fast reconfigurable antennas can 
be employed to establish ancillary virtual links between two 
devices. As the quality of the current channel degrades, it may 
become advantageous to transition to an alternate antenna state 
and, consequently, to another channel realization. 

This added flexibility at the physical layer is likely to boost 
the perceived performance of delay-sensitive applications over 
channels with memory. Indeed, several studies document 
the fact that channel variations are particularly detrimental 
to delay-constrained communications lfl2ll . |fl3l , fl4l . fl31 . 
Channel memory further exacerbates this situation, as it in- 
creases the propensity for prolonged deep fades fl6l . flTl . 
1 18]. Thus, having the capability to jump to a different virtual 
channel seems an attractive option in these circumstances. 

To carry our analysis of reconfigurable systems, we leverage 
several results that have appeared in the literature in the past. 
First, we adopt a class for channels with memory similar 
to the finite-state channel model proposed by Gilbert and 
Elliott Ifl9ll , Il20l . The delay-sensitive aspect of the problem 
is captured through a queueing formulation whose solution is 
obtained, partly, by applying techniques originally developed 
by Neuts ED . Il22ll . Il23ll . The conceptual bridge between 
the physical layer and the queueing system is provided by 
error correcting codes and the availability of feedback. The 
framework presented below parallels some of our previous 
work IfTTI , ifTSl . The incorporation of reconfigurable antennas 
into the problem setting and the insights provided by our 
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analysis are novel. This sheds new lights on the potential 
benefits of adaptive antenna systems and their application to 
delay-sensitive communications over wireless channels. 

Special attention is given to the realistic scenario where the 
channel state is not known perfectly at the receiver. Rather, 
it must be inferred from available observations. In this latter 
case, the optimization problem becomes a partially observable 
decision process. This forces the controller to make decisions 
based on an estimated distribution over the channel state. 
This problem is cast into a dynamic programming framework 
with limited state knowledge. Known system dynamics and 
partial observations are combined at every step to update the 
estimated distribution and, subsequently, take action. 

The remainder of this article is organized as follows. The 
system components, along with a mathematical abstraction 
for reconfigurable antennas, are described in Section [II] Two 
modes of operation are considered, a classical system with a 
static antenna structure and an adaptive implementation with 
the ability to reconfigure the RF front-end depending on the 
channel state. The evolution of these two competing schemes 
is characterized in Section [III] where we analyze their queue- 
ing behaviors. This gives rise to various performance criteria, 
including throughput, mean waiting time and the probability 
of the queue exceeding a certain threshold. Pertinent numerical 
examples are presented in Section [V] Finally, concluding 
remarks and avenues of future research are discussed in the 
last section. 

II. System Model 

In this study, we consider one side of the communication 
process. That is, information flows from a transmitter to a 
destination. An eventual assumption on the availability of 
feedback will necessarily imply the presence of a reverse link. 
Nonetheless, for the sake of simplicity, we focus on a single 
direction with the understanding that a similar analysis can be 
applied to the reverse link. We keep the descriptions of the 
system model to a minimum and refer the reader to lTT7l . [ 18 1 
for an elaborate exposition. 

As mentioned above, overall system performance is assessed 
using a queueing formulation. The state of the queue at the 
source is governed by arrivals and departures. The evolution 
of the queue is modeled as a discrete-time stochastic process 
that is synchronized with codeword transmissions. Specifically, 
during each codeword cycle, we assume that a data packet 
arrives with probability 7, independently of other time instants. 
The number of information bits per data packet, denoted by 
L, is also random and possesses a geometric distribution 
with parameter p. We emphasize that this arrival process 
is carefully selected to facilitate analysis. Since this article 
is primarily concerned with identifying the relative benefits 
of reconfigurable antennas over traditional implementations, 
adhering to a specific arrival profile is unlikely to affect the 
nature of our subsequent results. 

A. Traditional Implementation 

We begin our discussion of the queueing system with a 
mathematical description of the channel model associated 
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Fig. 1. A finite-state channel with memory is used to model the operation 
of a wireless link at the bit level. For illustrative purposes, the channel is 
depicted with only two states, a form known as the Gilbert-Elliott channel. 



with a fixed antenna configuration. This communication chan- 
nel can operate in one of several modes, designated by 
C = {1, . . . , k}. The evolution of the channel forms a time- 
homogeneous Markov process and its probability transition 
matrix is denoted by 
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where bij symbolizes the probability of jumping to state j 
given that the chain is currently in state i. That is, B is a right 
stochastic matrix. When in state i, the probability that a bit 
sent by the source is received faithfully at the destination is 
equal to 1 — this bit is consequently erased with probability 
Si. The elements of the state space C are indexed in such a 
way that i < j implies Si > Ej. In its simplest non-trivial 
instantiation, this finite-state channel with memory can take 
on two possible states. This specific model is known as the 
Gilbert-Elliott channel Q9), EDI. and is illustrated in Fig. Q] 
Finite-state channels have been employed to model wireless 
connections in the past, and techniques aimed at selecting 
representative model parameters are available |24|. [25|. 

The adverse effects of channel uncertainty are countered by 
the communication system using error-control coding. Data 
segments are first encoded at the source and then transmitted 
in the form of codewords to the destination. As discussed 
above, individual symbols may or may not be received at 
the destination depending on the realization of the finite- 
state channel. Decoding is executed on a per codeword basis. 
We assume that code performance is governed solely by the 
number of erasures that occur during a transmission interval. 
Obtaining a distribution for the number of such erasures, 
conditioned on the initial state of the channel, is therefore 
highly desirable. There exist various strategies to compute such 
distributions. Finding the distribution of the channel states and 
then computing the conditional distribution of the number of 
erasures is a possible approach [26|. Alternatively, one can 
employ generating functions and product of matrices with 
polynomial entries to derive these quantities |27ll . At this point, 
it suffices to point out that 

Pi(E = e,C N+1 =j\C 1 =i) (2) 

can be computed efficiently. Above, C n represents the state of 
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the channel at time n and E denotes the number of erasures 
within a block. 

We consider a standard and powerful approach to model 
forward error correction [28 1. Every codebook is created using 
a random binary parity-check matrix H of size (N — K) x N. 
The admissible codewords are the elements of the nullspace 
of H. Decoding at the receiver is executed using a maximum 
likelihood decision rule. The ensuing probability of decoding 
failure, conditioned on e erasures, is then given by 

e-1 

Pf(N - K, e) = 1 - JJ (l - 2*- (JV-x) ) (3) 

i=0 

where N is the code length and K designates the number of 
information bits per codeword 11291 . Accounting for channel 
states, the conditional probability of decoding failure at the 
destination, which we represent by Pdf (j; i), is given by 

N 

Pi(N - K, e) Pr (E = e, C N+1 = j\d = i) . 

Similarly, the conditional probability of decoding success, 
labeled Pds(j> 0> can ^ e written as 

N 

5^(1 - Pf(N - K, e)) Pr (E = e, C N+l = j\C\ = i) . 

e=0 

Thus, combining (O and (01, we obtain the probability of 
transitioning to state j with or without decoding success, 
conditioned on the channel being in state i. Collectively, these 
probabilities underlie the evolution of the queueing system; 
this is described next. 

To conform with our block encoding scheme, a data packet 
of length L must be divided into M — \L/K~\ segments, each 
of size K. The ending segment of a packet is zero-padded, if 
needed. Note that M is too a geometric random variable, albeit 
with parameter 

K 

Pr = £(1 - pf^p = 1 - (1 - P ) K . (4) 
1=1 

These segments are successively encoded into codewords 
of length N and sent over the finite-state channel. Upon 
successful decoding, the destination acknowledges reception 
of the information and the corresponding segment is discarded 
from the source buffer. On the other hand, when transmission 
fails, the source is notified. The leading data segment is 
then immediately re-encoded and transmitted once again over 
the wireless channel. This process continues until successful 
reception of the codeword at the destination. 

The number of packets awaiting transmission is selected 
as the state of the queue. This perspective reflects our incli- 
nation towards delay-sensitive communications. An alternate 
formulation would take the number of segments awaiting 
transmission as the state of the queue. This latter option 
would be more appropriate to evaluate the size of the memory 
necessary to store information at the source, at the expense of a 
less accurate delay characterization. It is worth reemphasizing 
that, in our framework, a packet departs from the transmit 
buffer whenever a codeword is decoded successfully at the 



destination and the corresponding segment is the last parcel 
of information of the lead packet. 

Throughout, we use Q s to identify the state of the queue at 
discrete-time s. Although the stochastic process {Q s } does not 
possess the Markov property, it can be shown that the channel 
state and the queue length at the onset of a codeword cycle, 
jointly designated by Y s = (C s n+i,Q s ), form a Markov 
chain |17|. The transition probabilities for this Markov chain 
can be calculated as follows. Suppose that the queue is non- 
empty, i.e., Y s = (i,q) where q > 0. Owing to our problem 
definition, the admissible values for Q s +i are {q — l,q,q + l}. 
Several factors can affect the evolution of the queue over 
time: the arrival of a new packet, the successful decoding 
of a codeword and whether or not this latter codeword is 
the last segment of a data packet. The only scenario that 
leads to a decrease in the queue is having no arrival and one 
packet departure. Recall that a packet departure occurs when 
a codeword is successfully decoded and the corresponding 
segment is the last parcel of information of the lead data 
packet. This yields 

m j =Pi(Y a+l = (j,q-l)\Y a = (i,q)) 

= {i- 1 )p As {r,i)p r . 

For the queue length to remain at a specific level, departures 
and arrivals must be balanced. In particular, there can be either 
no departure and no arrival, or one departure and one arrival, 

Kij =Pv(Y s+1 = (j,q)\Y s = (i,q)) 

= (i- 7 ) (P d{ (r,i) + Pds(j;i)(i-Pr)) 

+ -fPds(j\i)Pr- 

Finally, the queue increases whenever a packet arrives and no 
departure occurs, 

X ij =-Pv(Y s+1 =(j,q+l)\Y s = (i,q)) 
= 7 (P df (j;z)+P ds (j;i)(l-p r )). 

When the queue is empty, Q s — 0, similar arguments apply, 
except that there can be no departures, 

4 = p r (y s+1 = (j,o)|y s = (i,o)) 

= (1 - 7) Pr(C (s+ i) iV +i = j\C S N+i = i) 
\%=?T{Y s+1 = {j,l)\Y s = (i,Q)) 

= 7 Pl '(C( s +i)w+i = i\CsN+i = i). 

Possible transitions for a non-empty queue at level q are 
depicted in Fig [2] Again, for simplicity, the diagram assumes 
a two-state channel at the physical layer. 

B. Adaptive Antenna Implementation 

Although series of carefully designed experiments in ane- 
choic chambers have been reported previously in the literature 
on reconfigurable antennas [[6), 0, 0, establishing accurate 
mathematical models for particular system implementations 
can be a daunting task. Given that this article only offers a 
preliminary investigation on the topic, we make simplifying 
assumptions that are somewhat favorable to RF-agile devices. 
The rational behind this reasoning is to gain insight without 



Fig. 2. Possible transitions with partial labeling for a queueing system 
built upon a two-state channel model and operating using a fixed antenna 
configuration. Self-transitions are intentionally omitted. 



risking to prematurely discard a technology that may eventu- 
ally lead to significant gains. We postulate that reconfigurable 
antennas have a large number of possible configurations, 
and we assume that the wireless channels induced by these 
configurations are independent from one another. This is more 
likely to apply to situations where devices are embedded in 
rich scattering environments. A direct implication of these 
two hypotheses is that a wireless device equipped with a 
reconfigurable antenna can always elect to switch to a different 
virtual channel. Furthermore, once this transformation is ac- 
complished, the probability that the wireless channel occupies 
a particular state becomes equal to the stationary probability 
of this same state. 

The second aspect of reconfigurable antennas that war- 
rants attention is the latency of the morphing process. The 
amount of time necessary to execute an antenna reconfigura- 
tion depends heavily on the physics underlying the process. 
Envisioned technologies related to our present investigation 
include electronic switches, microelectromechanical systems 
(MEMS) and microfluidic devices. Collectively, these various 
techniques embody a range of options in terms of latency, 
efficiency and power consumption. They also offer funda- 
mentally different mechanisms that can provide measurable 
tradeoffs between speed, power handling, linearity and overall 
complexity. Moreover, they each feature a compact form factor 
suitable for mobile devices. Based on the state-of-the-art for 
these mechanisms, it is reasonable to assume that reconfig- 
uration latency is no greater than a typical codeword cycle 
(on the order of 4.615 ms). In our analysis, we assume that 
triggering an antenna reconfiguration event results in the loss 
of one codeword transmission opportunity; no segment can be 
decoded at the completion of the corresponding transmission 
interval and, as such, there cannot be a departure from the 
queue. This is the price to pay for the opportunity to access a 
fresh channel realization. 

We consider static control policies for antenna handling 
that are based solely on channel state. Furthermore, we look 
at hierarchical structures: if i is deemed deficient enough to 
initiate a channel reconfiguration, then j will also trigger a 
reconfiguration whenever j < i. While it may be possible to 
create idiosyncratic channel probability transition matrices for 
which this class of policies is highly suboptimal, hierarchical 
structures are expected to work well for realistic channel 
models derived from empirical observations. Implicit to these 
control policies is channel state knowledge at the source; this 



Fig. 3. In this diagram, the two-state antenna system evolves unaltered while 
in state (c2 , q) ; whereas an antenna reconfiguration is initiated whenever the 
system enters state (c\,q). The reconfiguration process alters the transition 
probability of the system, as designated by the tildes. 



construction again favors adaptive systems. More pragmatic 
schemes would have to employ state estimates or trigger 
a reconfiguration based on the number of successive failed 
decoding attempts. Nevertheless, our simplified framework is 
a logical starting point: if an adaptive system fails to produce 
significant gains when side information is available, then there 
is no need to study more intricate formulations. 

When the channel state is deemed satisfactory, no recon- 
figuration takes place and the transition probabilities defined 
in Section III-AI apply. On the other hand, when a system 
reconfiguration is initiated, the transition probabilities become 

fkj = PrOKs+i = (j, q - l)\Y s = (i, q)) = 

fty = Pr(r s+ i = (j,q)\Y s = (i,q)) = (1 - i)pc{j) 

Ay =Pr(n+i = (j,q+l)\Y 3 = (i,q)) = <ypc(j), 

where pc(-) is the marginal probability distribution of the 
individual wireless channels. We emphasize that these prob- 
abilities are completely determined by the latter stationary 
distribution and the probability of a packet arrival. In a similar 
fashion, we have 

~ K % = (1 - l)Pc(j) >H 3 = 7Pc(j) 

whenever a reconfiguration event is sparked from an empty 
queue. Fig. [3] presents a level-transition diagram for a two- 
state channel where an antenna reconfiguration is prompted 
whenever the channel state lies in the lowest level at the onset 
of a codeword cycle. It may be instructive to compare this 
graph with Fig. |2j whose labels embody the operation of a 
communication system with a static antenna structure. 

This completes the description of the queueing systems, 
with and without reconfigurable antenna structures. In both 
cases, the state space for the discrete-time packetized system 
is C x No- Each implementation will be stable provided that 
the average arrival rate is less than its expected service rate. 
When this is the case, the underlying Markov chain is positive 
recurrent and it admits a stationary distribution 11301 . In the 
next section, we further discuss stability conditions and we 
provide means to compute invariant distributions. This is 
performed by linking the mathematical formulation of our 
problem to classical queueing results. 

III. Queueing Behavior 

Recall that a new data packet arrives at the source at 
time s with probability 7. Moreover, the number of segments 
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contained in any packet is a geometric random variable with 
parameter p r , as described in The expected arrival rate in 
segments per block is then given by 



7E[M] 



Pr 



The expected service rate depends on the communication 
scheme employed. In the traditional implementation with static 
antennas, the progression of the wireless channel is unaltered 
at the codeword boundaries. The throughput in segments per 
block can be expressed as 



^^P ds ( j;i )pcW 

iec jec 



(5) 



where pc{-) represents the stationary channel distribution 
associated with matrix 
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We stress that, since B is assumed irreducible and aperiodic, 
its invariant distribution pc(-) exists and is unique Oil . This 
distribution is also invariant for probability transition matrix 
B*, which justifies its use in ©. 

Obtaining the probability transition matrix for the adaptive 
architecture with reconfigurable antennas is a slightly more 
involved task. Let C' = {£,... ,k} represent the collection 
of channel states judged suitable for data transmission. Then, 
necessarily, the set C\C' contains all the channel states for 
which a reconfiguration command is issued. In view of this 
partitioning, we gather that the probability transition matrix 
for the channel state at the onset of a codeword cycle is 



B W = 



Pc(l) Pc(2) 



p c (l) pc(2) 



b (N) 
°kl 



^12 
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We point out that matrix entry b\j is implicitly defined in 
©. Given that successful decoding is only possible when a 
codeword is sent, we can write the throughput for the adaptive 
system as 

iect jec 

where pc{-) is the invariant distribution associated with prob- 
ability transition matrix B^). 

When the average arrival rate is strictly less than the 
expected service rate, Foster's criteria guarantees that the 
corresponding Markov chain is positive recurrent ll30l p. 167]. 
It is instructive to point out that channel memory and channel 
quality can greatly influence the expected service rate of a 
communication system. This phenomenon is rooted in the 
subtle interactions between channel output sequences and 
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the probability of decoding success at the destination. It is 
illustrated through numerical examples in the next section. 

The channel state and the queue length at the onset of a 
codeword cycle, Y s = (C s n+i,Qs), jointly form a stochastic 
process with a countably infinite state space. A natural order- 
ing for its elements is the following, 

(l,0),...,(fc,0),(l,l),...,(fc,l),(l,2),... 

Collectively, the subset of states 

{(l,q),...,(k,q)} 

is known as the qth level of the chain. Using this ordering and 
the level abstraction, we can introduce a probability transition 
operator T for aggregate chain {Y s }, 

( d c 2 o o ... \ 

A Ai A 2 ■■• 
A Ai A 2 ■■• 
A Ai ■■• 
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In the case of a fixed antenna configuration, the submatrices 
A , Ai, A 2 are given by 
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When the queue is empty, the block transitions are governed 
by 
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These definitions have analog counterparts for systems with 
reconfigurable antennas; the appropriate entries are simply 
replaced by their homologues, 

j^ij i f^ij i Aij , K^j and . 

In both scenarios, with and without adaptation, the ensuing 
Markov chains belong to the class of random processes 
with repetitive structures ll22l . One can find the stationary 
distribution associated with T by inspecting the substochastic 
matrix U whose entry u tJ denotes the probability that, starting 
from state (1, i), the Markov chain Y s first re-enters level 
one through (1, j) and does so without visiting any state at 
level zero. A probabilistic path-counting argument leads to 
Proposition 13.11 

Proposition 3.1: Define Ui = Ai. The iterative expression 

U m+ i = Ax+A 2 (I-U m ) _1 A 

is well-defined for all m € N; its limit exists and 

lim U m = U. 
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Let 7T represent the invariant distribution of the augmented 
Markov chain, and denote the subcomponents associated with 
level q by ir q , 

7r, = (Pr(y = (l, «)),..., Pr(F = (*,?))). 

Proposition 3.2: Define R = A2(I — U) _1 and recall that 
the entries of tt are non-negative and sum up to one. The 
invariant distribution induced by T is entirely determined 
through the following relations, 



7T 7T1 



Cl C2 

A Ai + RA 



= [ttq TTl] 



(9) 



and 7r g = 7TiR 9 1 for q > 1. 

Propositions 13.11 & 13.21 provide an algorithmic blueprint to 
compute the stationary distribution of the augmented Markov 
chain: obtain U through repeated iterations; compute R and 
form irreducible and aperiodic probability transition matrix 



Ci C2 
A Ai + RA 



find its invariant distribution; append missing values of tt using 
TT q = ttiR 9-1 and normalize. 



IV. Performance Evaluation 

Once the stationary distribution is acquired, we can compute 
several performance criteria of interest. In this article, we 
examine the average delay, the probability that the queue 
length exceeds a certain threshold and the decay rate of the 
queue occupancy. First, we note that the expected queue length 
is given by 



^^•Un ^gR'- 1 1, 

g =o \g=i / 



(10) 



where 1 is a column vector of all ones. Using Little's formula, 
we deduce that the mean waiting time in the queue is simply 
( [Tol l divided by expected arrival rate 7. The decay rate of the 
queue occupancy can be written as 



lim - logPr(Q > r) = logg(R) 



(11) 



where f?(R) is the spectral radius of R; and its complementary 
cumulative distribution function is determined by the finite 
sum 

M 

Pr(Q > r) = 1 - £><T 

q=0 

In the next section, we use these performance criteria to 
show that time-dependencies in the underlying physical chan- 
nel can adversely affect the behavior of a queueing system. 
Moreover, having the ability to reconfigure an antenna struc- 
ture at appropriate moments can help mitigate the undesirable 
effects of channel memory. 



A. Partially Observable Systems 

Up to this point, we have looked at the possible benefits of 
reconfigurable antenna systems by comparing the performance 
of specific policies using various optimization objectives, e.g., 
throughput, average delay, queue threshold violation. To offer 
a different perspective, we study the communication process 
in a decision theoretic framework. At the onset of every 
codeword, the transmitter has the freedom to select an appro- 
priate code-rate or it can trigger an antenna reconfiguration 
when the channel quality is deemed deficient. The exact 
state of the channel is hidden from the transmitter, yet the 
device can estimate it from the acknowledgements of previous 
transmission attempts. In this latter scenario, the objective is 
to maximize the amount of information transmitted in the long 
run. The formulation of a partially observable Markov deci- 
sion process (POMDP) is immediate. A distinguishing feature 
of the proposed framework is that it naturally incorporates 
state estimation, code rate selection, antenna reconfiguration 
and throughput maximization. 

We note that the transmitter must base its actions on past 
observations. To act optimally, it is sufficient, surprisingly, to 
summarize previous observations into a belief state |32| . One 
such choice for the belief state is the probability distribution 
of the channel states conditioned on the past observations. 
Whenever the transmitter takes an action and collects an 
observation, this belief state must be updated. We refer the 
reader to [33 1 for the notation and solution methodologies for 
POMDPs. Below, we formally define the quantities involved 
in our problem formulation. 

A partially-observable Markov decision process consists of 
a tuple (C, B, A, O, T, 1Z, f2), as described below. 

1) As before, C represents the set of admissible channel 
states, {1, . . . , fc}, and C„ denotes the realization of the 
channel at time instant n. 

2) B C [0,1] k is the collection of prior distributions (or 
belief states) on the channel states at the transmitter. 
The belief at time instant n is written as B n . 

3) A is the space of actions, which includes different code 
rates and the reconfiguration event. Code rates of the 
form a/N, 1 < a < N, a € N are valid options. We 
index the code-rate a/N with a, and a reconfiguration 
event is labeled by 0. The action at time instant n is 
denoted by A n . 

4) O denotes the set of observations; these assume the form 
of an ACK or NACK obtained form the receiver. The 
observation at time instant n is denoted by O n . 

5) Q : B x Ax O ^ R + is the observation function which 
gives, for each action and a belief state, the probability 
of making an observation. 

6) T : B x A x O — > B denotes the transition function 
which produces, for each action and an observation, the 
updated belief state as a function of the previous belief 
state. 

7) 1Z : B x A — > R + gives the reward received for 
the corresponding action. For our problem, this is the 
number of transmitted information bits, if any, weighted 
by the probability of the successful reception. 
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Having established a proper framework, we proceed with 
the computation of the quantities T, 1Z, il for our problem. 
By definition, the observation function is given by 

to(ip, a, o) = Pr(O n+ i = o\B n = ip, A n = a), 

and, hence, 



Similarly, the infinite horizon value function is defined as 



Q(iji,a,o) 




o = ACK 
o = NACK 



for a 7^ 0. When a reconfiguration request is issued, we 
invariably get Q(iji, 0, ACK) = and n(^,0,NACK) = 1. 
The transfer function T updates the current belief state based 
on the action taken and the observation made. That is, 

[T(ip, a, o)]i = Pr (C n+ i = i\B n = ip,O n = o, A n = a) . 

This can be reduced to 

, N1 Pi" (C n+ i =i,O n = o\A n = a, B n = rp) 

[T(Vj ' a ' 0)k = Pr(O n = o\A n = a,B n = ^ ■ 

Writing the above equation compactly, for 

tpA , tpA 1 



T{i>, a, ACK) 



TO, a, NACK) 



V»A 1 ' ' VAil 

For the reconfiguration event, which we assume leads to a new 
virtual channel, we obtain 

T(tp, 0, ACK) = T(il>, 0, NACK) = p c . 

The reward function is the expected number of information 
bits received at the destination under state %jj upon action a, 
normalized by the length of a codeword, 

fcfoM) = fVA i. 

We define an rt-step policy A„ = {Si, . . . ,S n } as a 
collection of n functions that map each belief state in B to 
an action from A. The expected discounted reward function 
VA t .t ■ B -)• K+ is given by 



Va„,„W =E 



t=i 



^- L K{B t ,6t{B t )) 



where B\ — ip. Intuitively, Va„ n denotes the expected 
rewards received by executing the policy A„ for n-steps. 
However, the rewards procured in the future are discounted 
by a factor of j3 each time. In a delay-sensitive system, the 
discount factor can be thought of as penalizing the information 
bits that will be transmitted in the future. Still, this is a 
standard approach that ensures convergence and the existence 
of a solution. The n-step finite horizon value function is 
defined as the maximum of VA n ,n over all the policies, 



V n 



maxV A m . 



By the principle of optimality, the finite horizon value func- 
tions satisfy ll34l 

Vniip) — max TZ(ip,a) 

a<EA L 

+ /3^fi(o,V,a)K_ 1 TO,o ) a)) 

oEO 



V(ip) — maxE 



Y,(3 t - 1 n(B u s t (B t )) 



t=i 



where B% = ip and A is a sequence of functions {8t}^-i which 
map each belief state to an action. The optimal policy A* that 
maximizes the above equation is a stationary policy |35|. That 
is A* = {S t = 5*}^ for some function S* : B -> A. The 
infinite horizon value function can be approximated by a finite 
horizon value function according to ll35l Theorem 3] 

V(i/>) = lim V n (if>). 

n—>oo 

V. Numerical Results 

Although the methodology introduced above applies to gen- 
eral finite-state erasure channels with memory, our numerical 
study focuses on the Gilbert-Elliott model depicted in Fig. Q] 
This model has received a fair amount of attention in the 
literature. It captures many of the features associated with 
wireless environments such as uncertainty, fading and channel 
memory. Yet, it remains simple enough for a straightforward 
exposition of our findings. Overall, the Gilbert-Elliott model 
provides valuable insights about the operation of wireless 
communication systems without being overly intricate, which 
gives ground for its adoption. This is especially relevant for a 
first characterization of the potential benefits associated with 
reconfigurable antenna structures. 

The choice of a hierarchical control policy for the Gilbert- 
Elliott channel with side information is straightforward. The 
only non-trivial candidate is the adaptive policy where the 
source triggers an antenna reconfiguration whenever the state 
of the channel is 1 at the onset of a codeword transmission. 
The performance of this adaptive scheme is compared with 
the operation of a static system where the antenna structure is 
fixed and codewords are sent at every opportunity. 

For the Gilbert-Elliott channel model, the stochastic matrix 
B reduces to 

hi W2 

021 i>22 



B 



and it has only two degrees of freedom. One possible way to 
portray these degrees of freedom is to talk about the stationary 
probabilities of the states, 

& 21 „ .„ „s &12 



Pr(C = 1) = 



312 



Pr(C = 2) = 



521 



&21 012 

and channel memory; this is the approach we use throughout. 
The memory of a Gilbert-Elliott channel can be expressed at 
the symbol level using 1 — bn — 621. An equivalent way to 
characterize memory is to consider changes at the codeword 
level, 



i-b[y-b%> = (i-b 12 -b 21 r e[o,i) 



u(N) 



N 



(12) 



It is typically more insightful to plot results using the latter 
scaling and, as such, this is the unit we employ in our figures. 
Additional system parameters are selected to approximate the 
operation of a GSM communication link. The block length 
is set to N — 114. New packets arrive at the source with 



s 



probability 7 = 0.20, and their expected length is p^ 1 = 195 
bits. Based on a 4.615 ms codeword cycle, this yields a lightly 
loaded connection at roughly 8.45 kbps; these are realistic 
numbers for digital telephony. 

We assess the performance of our competing systems when 
operating over erasure channels with an erasure probability 
equal to 20 percent. We first explore the impact of channel 
memory on overall performance. We study a channel model 
with 612 = 4&2i, £1 = 0.5 and £2 = 0.125. Channel 
correlation over time is varied progressively from the memo- 
ryless case to a very slow fading profile. Note that the value 
of K is throughput optimized for every parameter set and 
system implementation, leading to a fair comparison between 
schemes. 

Figure |4] displays maximum throughput in bits per channel 
use as a function of the memory coefficient defined in ( fT2l . 
When channel memory is small, the communication system 
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Fig. 4. The throughput of a traditional communication system is compared to 
that of a competing implementation with a reconfigurable antenna. As channel 
memory increases, the performance of the reconfigurable system surpasses the 
maximum service rate of the traditional implementation. 



with a fixed antenna structure performs better. In particular, if 
the mixing time of the Gilbert-Elliott channel is shorter than a 
codeword transmission cycle, then reconfiguration offers little 
rewards. It is therefore more profitable to send codewords 
constantly. On the other hand, as the memory coefficient 
approaches one, the channel can get stuck in a bad fade for a 
prolonged period of time. This phenomenon almost certainly 
guarantees decoding failure at the next attempt. This prompts 
the RF front-end to trigger a reconfiguration and seek a more 
auspicious channel realization. The crossover point in Fig. [4] 
is approximately 0.28. Interestingly, at this crossover point, 
the expected sojourn time in state 1 is approximately 113 bits, 
which is very close to the actual block length. 

Similar curves can be generated for other parameter sets. 
Each of these curves identifies a crossover point in terms of 
channel memory and erasure probability where the through- 
put of the adaptive system overtakes the expected service 
rate of the traditional implementation. Plotting these points 
delineates the boundary of two regions, one where a static 
system with a fixed antenna structure performs better and 



a second region where the reconfigurable implementation 
delivers enhanced performance. This is illustrated in Fig. [5] We 
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Fig. 5. System parameters determine which implementation delivers better 
throughput, the static system with a fixed antenna structure (Static) or the 
switching scheme with reconfigurable antennas (Switch). Correlation and fade 
differentiation are advantageous to the RF-agile switching scheme. In this 
figure, the probability of erasure is set at 0.20 and £2 = (1 — £i)/4. 

immediately see from this figure that channel correlation over 
time favors reconfigurable antennas. In addition, experiencing 
vastly different channel qualities over the various fade levels 
benefits adaptive implementations. Altogether, the capabilities 
of reconfigurable antenna systems seem better suited to harsh 
wireless environments. 

We supplement the preceding results by investigating the 
performance of the two competing systems in relation to 
mean waiting time. This latter criterion is appropriate for 
lightly loaded connections and delay-sensitive applications 
such as mobile telephony and video conferencing. Again, we 
maintain the average rate of bit erasure at 20 percent, and 
we set the conditional probabilities of erasure to E\ = 0.5 
and £2 = 0.125. As before, we vary the channel memory 
coefficient to first produce a memoryless process followed by 
increasingly correlated erasure sequences. Figure [6] plots the 
mean waiting time at the source as a function of memory. The 
crossover point where the switching system with a reconfig- 
urable antenna structure overtakes the static implementation 
is approximately the same as in the case of throughput. In 
fact, preliminary results indicate that similar behavior can be 
observed for various parameter sets and different optimization 
criteria including mean waiting time, asymptotic decay rate 
in queue occupancy and threshold violation probability. This 
robustness may be attributable to the simplicity of the Gilbert- 
Elliott model and may not hold for more complex channel 
models. This observation warrants further research, but this 
lies outside the scope of our article. In practice, this suggests 
that good performance can be achieved with RF-agile antenna 
structures by identifying regions where reconfiguration should 
take place. The system can then estimate the current state of 
the channel and decide, according to its local map, whether 
or not a reconfiguration event should be triggered. 

Fig. [7] shows the numerical analysis of a two-state channel 
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Fig. 6. Mean waiting times for traditional and switching systems are plotted 
as functions of channel memory; a smaller waiting time is desirable. When 
the channel is weakly correlated over time, the system with a fixed antenna 
configuration performs better. On the other hand, in slow fading scenarios, 
the adaptive implementation with a reconfigurable antenna structure becomes 
advantageous. 
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Fig. 7. This figure shows the choice of optimal code rate versus the belief that 
the channel is in good state. Consistent with intuition, when the transmitter is 
more confident that the channel is in good state, it can use a high rate code. 
Conversely, when the transmitter is certain that the channel is in bad state, 
reconfiguring the antenna is beneficial. We note that the optimal code rate is 
a threshold based policy, partitioning the belief space. 



from the POMDP perspective presented in Section IIV-AI The 
parameters for the analysis are: E\ = 1, £2 = 0, a channel 
memory coefficient of 0.3, an average erasure rate of 20%, 
and discount factor /3 = 0.9. For this two-state channel, the 
belief vector lies in a two-dimensional simplex. Yet, since 
the two elements in the belief vector sum to one, only the 
second coefficient is kept, namely the belief that the channel 
is in a good state. More precisely, Fig. [7] shows the decision 
regions (optimal action to choose i.e., 6*) as a function of 
the belief that the channel is in a good state. We observe that 
the optimal policy is a threshold based policy partitioning the 
belief space. The optimal code rate is monotonically increasing 
as a function of belief state. Fig. [8] shows a similar analysis 
for a three-state channel with a transition probability matrix 



B 



0.998 0.002 
0.001 0.998 0.001 
0.002 0.998 



and erasure values e\ = 1, £2 = 0.15, £3 = 0. This gives an 
average erasure rate of 20% and a channel memory coefficient 
of 0.8. The discount factor used for the computation of infinite 
horizon value function is /3 = 0.9. Fig. [9] shows the expected 
value function (averaged over the belief space) for a two-state 
channel with E\ — 1, £2 = 0, an average erasure rate of 20%, 
and discount factor f3 — 0.9. In the high memory regime, 
whenever the channel is in bad state, successful receptions 
in the fixed antenna system are heavily delayed. Since, the 
delayed rewards are discounted by a factor of j3 = 0.9, 
the average value function is small in this regime for this 
system. On the contrary, in the reconfigurable antenna system, 
prolonged bad channel states can be circumvented by issuing 
a reconfiguration event and thereafter transmitting during the 
prolonged good channel states, thus exploiting the benefits of 
high channel memory. This explains the large gap between the 
mean value functions of the two systems in this regime. 
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Fig. 8. This figure shows the choice of optimal code rate according 
to the belief. The darkest region corresponds to the belief space where a 
reconfiguration event is beneficial. The region in white corresponds to the 
belief space where using a code rate of 1 is beneficial. The regions in gray 
correspond to different code rates; the lighter the region, the higher the code 
rate. 



VI. Concluding Remarks 

This preliminary study offers supporting evidence to the 
claim that reconfigurable antenna structures can improve the 
performance of communication systems significantly. For the 
reconfiguration process to be beneficial, the potential rewards 
of a reconfiguration event must offset the costs of a loss of 
a codeword transmission opportunity. Two conditions appear 
to influence this balance. The coherence time of the physical 
channel must be on the order of the codeword cycle or longer. 
Furthermore, the quality of the channel must vary significantly 
over the different fade levels. Slow fading channels appear to 
be great prospects for reconfigurable antenna systems with 
adaptive control policies. 



10 



a 
o 
■o 

o 
d 

u 
3 

u 

s 
















* 




* 






















Fixed Antenna 

Reconfigurable Antenna 

i 



0.2 0.4 0.6 0.8 

Channel Memory Coefficient 

Fig. 9. Comparing the mean value functions for both traditional system and 
reconfigurable antenna system. The greater flexibility of the adaptive system 
yields a dominating performance curve. Still, adaptation only pays off in harsh 
environments where performance is strictly better. 



Future studies should address practical issues. Once side 
information becomes available at the transmitter, power control 
and scheduling can be employed in conjunction with reconfig- 
urable antenna structures. Extending the queueing formulation 
to account for these techniques is an interesting goal. Also, 
the postulate that virtual channels are independent from one 
another should be explored through empirical measurements. 
A strong positive correlation among virtual channels would 
reduce the expected returns of a reconfiguration event. These 
are promising avenues of future research that may broaden 
the application potential of reconfigurable antennas and help 
improve the performance of wireless communication systems. 
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